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[57] ABSTRACT 

The invention is a multiple interconnected network of 
intelligent message-repeating remote nodes which em- 
ploys a remote node polling process performed by a 
master node by transmitting a polling message generi- 
caUy addressed to all remote nodes associated with the 
master node. Each remote node responds upon receipt 
of the generically addressed polling message by trans- 
mitting a poll-answering informational message and by 
relaying tiie polling message to other adjacent remote 
nodes. 

4S Claims, 7 Drawing Sheets 



14-v 


MASTER 






NODE 







05/21/2004, EAST Version: 1.4.1 



U.S. Patent 



May 16, 1995 



Sheet 1 of 7 



POLL-ANSWERING MESSAGE | 


TIMING 1 


SEQU 






* 


:s 
tn 






DIRECTION 


DIRN 
OF 
POLL 








FLOOD 






* 


POLLING MESSAGE 


RELAY BY 


ONWARD 
ONLY 








FLOOD 








ADDRESSED TO 


TARGET 
NODE 
ONLY 


* 






ALL 
NODES 




* 


* 




PARENT 
APPLICATION 


PREFERRED 
EMBODIMENT 


ALTERNATIVE 
EMBODIMENT 



05/21/2004, EAST Version: 1.4.1 



U.S. Patent May 16,1995 sheet 2 of 7 5,416,777 



NODE 1 NODE 2 NODE 3 NODE 4 

□ □ D 

MASTER 



> 



NODE -NODE 5 

-a- 

NODE 9 NODE 8 NODE 7 NODE 6 

FIG. 2 a 




FIG. 2b 



05/21/2004, EAST Version: 1.4.1 



U.S. Patent May 16, 1995 sheet 3 of 7 5,416,777 




52 



NO ACTION ^ 




PUT ID NUMBER 
INTO STACK 



58 



NO ACTION 



FIG. 3 a 




REPEAT 
MESSAGE 



DECODE MESSAGE 



05/21/2004, EAST Version: 1.4.1 



U.S. Patent 



May 16, 1995 



Sheet 4 of 7 



5,416,777 



FIG. 36 





r 



62 



IS THE MESSAGE A GENERICALLY 
ADDRESSED POLUNG MESSAGE ? 




TO 64 



202 



DETERMINE PORT ON WHICH 
POLUNG MESSAGE ARRIVED 



i 



204 



TRANSMIT POLL-ANSWERING MESSAGE ON THAT 
PORT AND SIMULTANEOUSLY TRANSMIT GENERAL 
POLUNG MESSAGE ON ALL OTHER PORTS 



I 



RNISH 



FIG. 3 c 





62 



IS THE MESSAGE A GENERICALLY 
ADDRESSED POLUNG MESSAGE ? 




TO 64 



210 



TRANSMIT POLUNG MESSAGE ON ALL PORTS 



i 



TRANSMIT POLL-ANSWERING 
MESSAGE ON ALL PORTS 



I 



212 



FINISH 



05/21/2004, EAST Version: 1.4.1 



U.S. Patent May 16, 1995 sheet 5 of 7 5,416,777 




18b 



FIG. 4 



78- 



■186-1 



18a 



18a-l 



>6o OPTICAL BYPASS r- 



ELECTRiCAL 



OPTICAL TO 
ELECTRICAL M 
CONVERSION 

T 

74 



84- 



82 



72 
76-> 



SERIAL/PARALLEL 



86- 



NODE 
MEMORY 



SERIAL/PARALLEL |J 
CONVERSION 



18a-2 



68 



OPTICAL TO 



ELECTRICAL 
TO OPTICAL U 
CONV ERSION 

1 



80 



MICROPROCESSOR 



POWER 
SUPPLY 



^88 



DATA ACQUISITION AND CONTROL FUNCTIONS 



108 



I 



FORMAT 
CONVERSION 



106 



102 



FORMAT 
CONVERSION 



OPTICAL TO 
ELECTRICAL 
CONVERTION 



104 



I 



I 



FORMAT AND 

LEVEL 
CONVERSION 



ISOLATION 



OPTICAL 
SENSOR 



I 



m7-98 



ISOLATION 



ELECTRICAL 
SENSOR 



' 100 ' 



i 



^94 



CONTROL 
SIGNAL 
OUTPUT 



CONTROL 



05/21/2004, EAST Version: 1.4.1 



U.S. Patent May 16,1995 sheet 6 of 7 5,416,777 



3 

< 



i 

_J 

Q. 
CL 

< 



b S 2 




O rn 

rsiujp 
o 

/N 



z 
llJ 

UJ 

Ql 



o 
z 



o 



g 
(/) 

UJ 



if) 

o 
o 
o 



o 
q: 

o 
o 

a: 
o 
q: 

UJ 



o 

Q. 



rrri 



mo 

gs 

OUJ 
QUJ 



o w to 



7 

oo 



So 

OOZ 

o3 

HU. 



m 



7 

o 

CM 



OUJ 

<a: 

OZJ 

li_0 
Q. 



S 

cn 
>- 

X 
Q. 



7 

CM 

eg 



o 

1^- 



co 

1^- 



oo 

< 2 

in 

LJ O 



Ul 

[2^ 



0(0 

Ft'? 
o 



So: 
og 



CO 

d 



05/21/2004, EAST Version: 1.4.1 



U.S. Patent 



May 16, 1995 



Sheet 7 of 7 



5,416,777 




d 

I — I 

6h 



05/21/2004, EAST Version: 1.4.1 



5,416,777 

1 2 

is TnaxrmTiTn because the loss of a single link (or even 
HIGH SPEED POLLING PROT OCOL FOR several links in most cases) cannot prevent the message 

MULTIPLE NODE NurrWORK from eventually reaching its destination, because the 

message travels on all links. 
BACKGROUND OF THE INVENTION 5 The entire network is monitored by each master node 
ORIGIN OF THE INVENTION periodically polling all nodes within its zone. In doing 

Tlie invention described herein was made in the per- f ' master node transmits a polling message ad- 
formancc of work under a NASA contract, and is s^b- ^ oertam node, to which only the addressed 

ject to the provisions of PubUc Law 96-517 (35 USC ,n responds with an answenng message. Once it 
202) in which the Contractor has elected to retain tide. ^«^f answenng message, the master node re- 

peats the process for the next node until all nodes in the 
CROSS-REFERENCE TO RELATED zone have been poUed. Thus, the master node transmits 

APPLICATIONS a succession ofpoUing messages to successive nodes and 

This application is a continuation in part of U.S. pa- . - receives successive responses. In the parent application, 
tent application Ser. No. 07/683,269 filed Apr. 10, 1991 polling message and the answering message are 

by Harold Kirkham entitled "Protocol for Multiple flooded throughout the entire zone of the nctworic The 
Node Network** and assigned to the assignee of the poU message may be a request for data or a command to 
present application (hereinafter referred to as '"parent perform some function at the node: the network opera- 
application", the disclosure of which is incorporated tion is the same. 

herein by reference, now U.S. Pat No. 5,341,372. While the foregoing provides an orderly and highly 

TECHNICAL FIELD reliable polling system, it consumes a great deal of time 

ic\.nrn\.Ai^ ric^s^u polling all nodes, which slows down the routine 

The invention is a communication network of inter- process of data acquisition, the primary application for 
connected zones of intelligent nodes which employs a which the protocol of the present invention is intended, 
high speed polling process performed by nodes which This is because each polling message must be relayed 
arc master nodes governing respective ones of the through intervening nodes to the message's destination 
^oncs. node, the requested operation (data acquistion or con- 

BACKGROUND ART ^ perfonned, that node's response must be 

^ . ^ ^ ... m relayed back and then the foregoing process must be 

The parent apphcation identified above descnbes a repeated with the next node to be polled. Thus, the 
communication network of nodes, each of the nodes polling time for a network increases rapidly as a func- 
mcludmg a node processor for rclaymg messages be- tionofthcnumber of nodes, a significant disadvantage. 
tween others of Ae nodes. A P^^ahty of hnks connect p^r example, in a simple version of the type of network 
^e^nodes m multiple rmgs of nodes, the nenvork bemg described in the parent apphcation comprising (in this 
divided mto plural zones wherem each node responds ^wa^^i^x « Ir JZfL t. • v • 

only to a maker node in the local zone. Those nodes ^^T^^tSi W V "^T. 

locited at boundaries between adjacent zones are gate- til^^^^^^ ^ master node would 

way nodes and respond to master nodes of the adja1:ent ^S^^ltf ^^^^ !h "^'I! m^age^ansmissions 
zoiL, each of th^teway nodes being comiecied to i^^, Ik^.^iT^h-^ ^^^^ 

nodes in adjacent Lncs of the network. Each node 40 the disadvantage of the tune reqinred to 

processor performs a distributed protocol for terminat- network was justed by the mherent rehabihty. 

ing a message if the message or a reply to the message Accordingly, it is an object of the invention to reduce 
fromanothernodehasbeenpreviouslyreceivedorseen amount of time required to poU all nodes without 

at the node. The node processors of the master nodes concomitantly reducmg the rehabihty of the network, 
perform polling by transmitting a message authorizing a SUMMARY OF THE INVENTION 

particular one of the other nodes in the local zone to _^ .... 
transmit a new message, while the node processors in J^^ mvention is an unprovement in the type 

other nodes transmit a new message only upon receipt °^ network disclosed m the parent application which 
of the pollmg message from the local master node au- greatiy reduces the number of **hops" required to poll 
thorizing the particular node to transmit a new message. 50 all nodes without significantiy reducing the reliability of 
The poUing feature permits all control of communica- ^^^^ * network. Specifically, the succession of polling 
tion in the network to be concentrated in the master messages addressed to different individual nodes is re- 
nodes, placed by a single polling message not addressed to any 
Onefeature which majrimizes the reliability of such a particular node (or, equivalently, addressed to all 
communication network is that the transmitting and 55 nodes), so that it elicits a response from each node it 
relaying of messages (including polling messages) by encounters. The first node to receive the polling mes- 
cach node in the network is performed in accordance sage transmits an answering message in the return dircc- 
with a flooding method in which each node broadcasts ^on (i.e., down the link that the polling message arrived 
the message it is transmitting or relaying to all adjacent from), but not in any other direction. Meanwhile, the 
nodes. As a result, a message transmitted on the net- 60 first node broadcasts the polling message in all other 
work will be broadcast eventually to all nodes, but, directions G-e., down all other links to which it is con- 
becauseofthe "antibody" algorithm performed by each nected, except the link down which it transmits the 
node (in which the node kills any message it has previ- answering message). Next, a second node (Le., the node 
ously transmitted), the message is repeated by each closest to the first node) receives the polling message 
node only once. The method of the invention **fIoods" 65 relayed by the first node, and the second node follows 
the network with the message and chooses the shortest the same procedure previously performed by the first 
path between the transmitting and receiving nodes be- node. Specifically, the second node transmits an an- 
cause it chooses all paths. Reliability of such a network swering message to the first node (i.e., down the return 
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direction firom which the rdayed polling message ar- FIG. 3* is a flow diagram of a distributed protocol 

rived at the second node), while simultaneously the process employing the preferred embodiment of the 

second node repeats or broadcasts the polling message high speed polling process of the present invention; 

in all other directions. FIG. 3c is a flow diagram of a distributed protocol 

In a preferred embodiment of the present invention, 5 process employing an alternative embodiment of the 

all nodes are programmed to broadcast any message high speed polling process of the present invention; 

other than a polling message in all directions, so that FIG. 4 is a block diagram of a typical node of the 

poll-answering messages from remote nodes flood the network of FIG. 2; 

networL Thus, in the foregoing example, the second FIG- 5 illustrates an architecture for implementing 

node's answering message is broadcast by the first node 10 the process of FIG. 3 in the network of FIG. 2; 

on all links to which the first node is connected. FIG. 6 illustrates a preferred block fonnat for mes- 

The advantage of the invention is that the remote sages employed in the embodhncnt of FIG. 2. 

nodes transmit their answering messages to the master FIG. 7 illustrates one embodiment of the invention 

node as fast as the polling message travels from node to including a hybrid dual-level network, 

node throughout tiie network. In contrast, the net^vork 15 DETAILED DESCRIPTION OF THE 

of the parent apphcation had a delay between succes- INVENTION 
sive poll-answering messages received at the master 

node corresponding to the transit time of the next pel- Distributed Protocol of the Parent Application 

ling message to the next node to be polled and the tran- ^® network protocols of the parent application were 

sit time of the next node's poll-answering message back developed to meet the requirements of communicating 

to the master node. It will be recalled that in the simple particularly for the purpose of data acquisition in an 

exemplary network discussed previously with reference electric power distribution systcnt Maximum reliability 

to the parent application, a total of 50 "hops" were ensured by the use of network flooding, in which 

required to poll all nodes. In the present invention, tiic every commumcation node repeated every message not 

same network layout would require only 10 hops to poU ^ ^^ended for it. Messages previously repeated by a node 

all nodes, a factor of 5 improvement in speed where tiie removed Ci.e., not repeated again) by that node, 

number of nodes is 10. A greater improvement fector is ^ ''^^^^^ controlled centrally by a 

achieved in larger networks. mechanism. No node was allowed to transmit 

The reliability is not reduced comcomitantly, how- ^^^^as ^re^ 

ever (i.e., in the above example it would not be reduced '° TT^t^J.^?^ f^^^^^ ""T^f' 

by a factor of 5). Since the polling message floods the iT;t^.^Jr.^ ^ a controfled and orderly sys- 

network, the polling process of the present invention is ^1^^ *^^^^^^ of data acquisi- 

susceptibletofailureo^y.t^^^ SoS;^^SS^S^^^^ 

tion IS broken sometime during the very short tmie 35 ^ ^3 ^^^^ slower. The programr4ig of !Sh^Se 

mter^^ after a node luis received the polhng message ^^e foregoing system of thf parent appS^i^ 

from the ups^eam node and before^^ 3^3^^"^^ P P^^^^ ^ 

caved back at the uptetream node. The^cr the mes- High Speed Polling Process of the Present Invention 

sages are flooded m the m^er d^cnbed m the above- ^he effective s^ed is significantiy mcrease^ in Ae 

referenced par^t apph^uon The fje mterval re- 40 high speed pomng^tocolTtiie prLnt invention by 

ferred to above ^ so short tiiat the probabdity of such a programming ^Microprocessor of each node in 

fadure is neghgible^ Thus, a neghgible decrease m reb- ^ordance with tiiat row of tiie table of HG. 1 which is 

abihty IS mcurred for a very large mcreasc m polhng labelled "PREFERRED EMBODIMENT**. Before 

• *; r ui * *u . . ^ J discussing the table of FIG. 1 in detail, however, tiie 

In a vanation apphcable to the pr^t mvention and 45 physical structure of a network embodying the pr^nt 

to the abovcKreferenced parent apphcation, some of tiie invention will first be described witii reference to FIG 

nodes are programmed to not respond to a general 2a. 

polling message, but to respond only to a specific type Consider tiie ring of remote units labcUed nodes 1 

or class of polling message, or to respond only to every through 9 and tiieir master node in tiie network of FIG 

n'A polling message, wherem n is an integer, and is in- 50 2a In tiie polling metiiod of the parent apphcation, tiie 

versely proportional to the relative unportance of the master node would send a poll (which is a command or 

particular node. This variation further reduces tiie aver- a request for data) to node 1 first The poll has to travel 

age time required to perform one polling cycle. the lengtii of one fiber (Le., tiie optical fiber between tiie 

BRIEF DESCRIPTION OF THE DRAWINGS niaster node and node 1) to reach its destination. This 

, 55 may be thought of as one "hop". Node 1 responds by 

Preferred embodiments of tiie mvention are de- transmitting a poU-answering message, which reaches 

scribed below m detail witii reference to tiie accompa- tiie master node after a second "hop" in tiie opposite 

nying drawings, of which: direction over tiie same cable. Therefore, after two 

FIG. 1 iUustrates a table summanzmg how node pro- *liops" the master has received tiie requested data, and 

cessors in a multiple node network embodying tiie in- 60 polls node Z This second poU specifies tiie address of 

vention are to be programmed in comparison witii tiie node 2 and tiierefore is relayed (ratiier tiian answered) 

parent application; by node 1 and reaches its destination after a total of two 

FIG. 2a is a block diagram of a simple network em- hops. The poU-answering message from node 2 arrives 

bodying tiie invention as a tutorial example; at tiie master after a fimher two hops. Altogetiier fifty 

FIG. 26 is a block diagram of one representative 65 hops are required for the master node to coflect tiie data 

embodiment of the network of the invention; from the 9 remote nodes (nodes 1-9) of FIG. 2a 

FIG. 3fl is a flow diagram iUustrating a distributed In accordance witii tiie high speed poUmg protocol 

protocol process of the parent application; of the present invention, tiie polhng message is a broad- 
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cast message spedfying a generic destination address example being the X-ON/X-OFF protocol. Other con- 
(or no address at all) to which each of the nodes 1-9 gestion control methods are known, and may function 
responds upon receipt The first node to receive the with equal effect 

polling message responds with a poU-answering mes- There is a very small decrease in reliability compared 
sage in the return direction and simultaneously repeats 5 to the original protocols described in the application 
the polling message in the onward (all other) directions. referenced above. If the network is damaged along a 
In the case of the ring of nodes 1 through 9 in FIG. 2a» fiber connected to a responding node during the short 
the master node transmits the polling message at both of time interval between the receipt of the poll and the 
its ports simultaneously. Nodes 1 and 9 will receive the receipt of the response, the response will not arrive at 
message first and respond simultaneously so that their 10 the master node. In the parent application, a copy of the 
poU-answering. messages will arrive simultaneously at response would be flooding out along aD other fibers, 
the two ports of the master node to which they are and while the response might take longer to return than 
connected. This means that the master node must be the polling message was in transit, it would have arrived 
programmed to separately buffer messages arriving if any duplicate path existed. In the present invention, 
simultaneously at its two ports. The same analysis ap- 15 only the shortest path carries the response on its first 
plies at any node located where the network branches. hop (which is why the method has slightly increased 
At the end of two hops, then, the master node has vi^erability to failure). All other fibers are carrying 
received the data from the closest two nodes (nodes 1 the polling message. This is a trade-off that would be 
and 9% and the next two closest nodes (nodes 2 and 8) acceptable in most applications. The method of the 
receive the polling message. After ten hops, the data 20 present invention uses flooding for propagating all mes- 
from all nodes have been received at the master. This sages throughout the network after this first hop, and 
represents a performance improvement of a factor of 5 (as in the above-referenced parent application) does not 
in speed. Acquiring data in the present invention from require any node to know the configuration of the net- 
all nodes takes no more time than acquiring data from work. 

the most distant node, alone, a dgnificant advantage. 25 Each of the foregoing features of the invention is 
There are no message collisions and no unpredictable readily implemented by the skilled worker in view of 
delays. In a more compicated topolgy, these advantages the foregoing teachings by programming appropriate 
are retained. There may be the need sometimes to buffer changes in the software instructions stored in the micro- 
the data, but this does not represent a significant draw- processor memories of each node and of the master 
back. The approach works because, at any general 30 node. 

node, the polling message is bound to arrive first by the Programming the Node Microprocessor in Accordance 
shortest path, and any node along this path that is closer With Each of the Embodiments of the High Speed 
to the master has already seen the polling message. Polling Protocol of the Present Invention 
responded and is idle. The microprocessor of each remote node is pro- 

In the event that the devices being served by the 35 granmied with instructions which implement the high 
network operate more slowly than the network itself, speed polling protocol of the present invention. As 
the time taken to read in the polling message and the mentioned previously, the table of FIG. 1 suxmnarizes 
time taken to insert the response back into the network the variables that must be programmed (across the top 
could be large compared to the time taken to poll the of the table). The first row in the table of FIG. 1 (la- 
entire network- In this case, the relative timing of the 40 belled "PARENT APPLICATION") corresponds to 
responses cannot be predicted based on the order of the network of the parent application, and is provided 
polling. As the responses are being passed to the master, for the sake of comparison with the present invention, 
the liklihood of two different messages arriving at a The second row (labelled "PREFERRED EMBODI- 
node nearly simultaneously increases. It is possible to MENT*) corresponds to the present invention. The 
imagine a situation in which, as messages are handled at 45 third row (labelled "ALTERNATIVE EMBODI- 
junction or intersection nodes, the buffers at some par- MENT*) corresponds to an alternative embodiment of 
ticular intersection node all become full Once this has the invention. 

Iu4>pened, the arrival of further messages would cause The variables that must be progranmied to realize the 
loss of data. high speed polling protocol of the present invention 

Some mechanism that performs the function of con- 50 include (reading from left to right across the top of the 
gestion control can be used to prevent the loss of data. table of FIG, 1): what nodes the polling message is 
In implementing the present invention^ the use of hand- addressed to, how the polling message is relayed from 
shaking (the exchange of signals to indicate readiness to node to node, the direction in which the node transmits 
receive data and acknowledge its reception) between its poU-answering message, the timing of relaying the 
adjacent nodes is not required. This handshaking can 55 polling message relative to the transmission of the poll- 
sometimes be used to avoid congestion in the network, answering response. 

but it can sometimes cause problems in the case of low- In the parent application, these variables are pro- 
grade lines. (Fiber optics are generally high-grade, grammed as follows in accordance with the row of the 
which permits avoidance of handshaking without incur- table of FIG. 1 labelled "PARENT APPLICATION" : 
ring a significant increase in the number of corrupt 60 the polling message b addressed to a particular target 
messages.) In the absence of handshaking, some other node, and is relayed by flooding throughout the net- 
form of flow control can be used. work; the poll-answering message is broadcast on all 
In the present invention, an approach that sends a ports of the node so as to permit it to flood the network; 
signal from a node approaching a condition of a full and, the poU-answering messages from other remote 
buffer to all its neighbors to inhibit ftoher sending is 65 nodes are relayed by broadcasting them on all ports of 
preferable. The node sends a signal that indicates the the node so that such messages flood the network, 
neighbors are clear to send when the buffer is no longer In the preferred embodiment of the present invention, 
as full. This kind of flow control is well-known, an these variables are programmed in accordance with the 
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row of the table of FIG. 1 labelled *TREFERRED process propagates throughout the network until every 
EMBODIMENT" as follows: the polling message is Imk has passed the message once. As a result of such 
addressed generically to all nodes controUed by the "flooding", scvotJ copies of each message will be re- 
master node 14 and is relayed by each node on all ports cdved at the destination node, 
other than the port on which the polling message was 5 Because fiber optics arc used m the preferred embodi- 
rcceived; the poll-answering message is transmitted by ment, communication reliabihty is so high that error 
the respondmg node on the port from which the poUing correction is unnecessary. Should a message be cor- 
mcssage was received, and the timing is such that the rupted before reaching its destination by one particular 
transmitting of the poll-answering message and the path, another "good" copy will arrive over a different 
relaying of the polling message is simultaneous (or 10 path in most cases. Since the several copies of the re- 
nearly so); and, poll-answering messages received from ceived message will travel along different paths, inter- 
other nodes are relayed by broadcast on all ports so as ruption of a given path will not prevent arriv^ of at 
to flood the network with such messages. least one copy of the message. Therefore, reliabihty is 

In an alternative embodiment of the present inven- maximized. The network will function even when fibers 
tion, these variables are programmed in accordance 15 are broken disconnecting some nodes from one or more 
with the row of the table of FIG. 1 labelled "ALTER- their neighbors. 

NATIVE EMBODIMENT" as foUows: the polling The distributed protocol process of the invention 
message is generically addressed to all remote nodes as resembles the working of the human body's nnmune 
in the previous embodiments, but is relayed by transmit- system. The first time a T-cell in the immune system is 
ting it on all ports of the node so that it floods the net- 20 exposed to an invading organism, it learns to recognize 
work; the poll-answering message b transmitted on all the organism as "non-self. On a second exposure, the 
ports of the node so that it too floods the network, while T-cell stimulates production of antibodies that kill the 
its timing is sequential with respect to (Le., before or mvader. In the present invention, the messages are anal- 
after) the relay broadcast of the polling message; and, ogous to the invader, and they wander throughout the 
poll-answeiing messages received from other remote 25 network of FIG. 2b as fax as available communication 
nodes are broadcast on all ports of the receiving node so channels will aUow. On first exposure to a message, 
that such messages flood the network. each node 16 extracts and stores information that will 

Typical Network In Which the Present Invention is allow it, on a second exposure, to kill the message. 
Employed Distributed Protocol Process of the Parent Application 

In the multiple interconnected ring network of FIG. 30 The distributed protocol process of the parent appU- 
2b, any node 16 or master node 14 can transmit a mes- cation performed by each node 16 in the multiple inter- 
sage in the network. In order to effect the distributed connected ring network of FIG. 2b is illustrated in FIG. 
protocol strategy, every message contains a unique 3a. It begins as a message is received by a particular one 
identifying number that can be stored in every node 16 of the nodes 16 (block 4S of FIG. 3fl). The node 16 first 
that it passes through. Since the operation of the nodes 35 determines the unique identification number of the re- 
16 in the separate rings 22 is assumed to be independent, ceived message and determines whether that same num- 
thc information required to identify a message uniquely ber (or a greater number corresponding to the response 
can be based on the source address of the originating to the message) was previously stored in the node's 
node and the time the message was originated, in one memory (block 50 of FIG. 3a). If the node finds the 
embodiment of the invention. This address may either 40 same identification number (or the greater number cor- 
be a logical address or the "street* * address of the origi- responding to the response to the message) stored in its 
nating node. Each node 16 has a memory stack in which memory (YES branch of block 50), then the node 
the identifying numbers of all passing messages are "kills" the message by not retransmitting it to other 
stored for future reference. nodes and taking no other action with respect to the 

At all nodes, any received message (except a generi- 45 message (block 52 of FIG. 3a). Otherwise (NO branch 
cally addressed polling message in certain embodiments of block 50), the node copies and stores the message's 
of the present invention) is retransmitted on all outgoing identification number in a memory stack (block 54 of 
lines, unless the message has been seen before, or is FIG. 3a). 

addressed to the node in question. Another approach In the remaining steps of the process of FIG. 3a; it is 
would inhibit the retransmission of a message if the 50 assumed that the message includes data bits identifying 
reply to it has already been seen at the node. By adopt- the location of the message origin as well as its destina- 
ing such a strategy, a message inserted anywhere into tion in the network of FIG. 2b. The node determines 
the multiple interconnected ring networic of FIG. 2b whether it is the node which previously originated the 
will be broadcast to all nodes 16. Furthermore, the received message (block 56 of FIG. 3a). If so (YES 
message will not be repeated by a given node more than 55 branch of block 56), the node "kills" the message by 
once. All links between nodes carry the message exactly taking no further action (block 58 of FIG. 3a). Other- 
once. The process is therefore as economical in opera- wise (NO branch of block 56), the node next determines 
tion as a single ring with an active monitor node. It is in whether it is the destination of tiie message (block 60 of 
some ways more efBcient than a method which relies on FIG. 3a). If the message does not bear the destination 
some central unit working out a route for messages to 60 address of the present node (NO branch of block 60), 
go from node to node. The method of the invention the node repeats the message to the other nodes in the 
•^floods" the network with the message and chooses the network (block 62 of FIG. 3fl). Otiierwise (YES branch 
shortest patii between the transmitting and receiving of block 52), the node decodes the message and re- 
locations because it chooses aH paths. Transmission spondsaccordingly (block 64 of FIG. 3a). For example, 
delay is therefore mmimircd. In floodmg the network 65 if the message is a diagnostic message, the node pcr- 
witii the message, many copies of the message circulate forms the tasks required in the message. It should be 
simultaneously in different ones of the multiple inter- noted that tiie steps of blocks 56 and 58 may be unncces- 
connected rings of the network of FIG. 2b, and this sary in some embodiments of the invention where, for 
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example, the network topology is such that the originat- other types of messages, all master nodes 14 are pro- 

ing node will never receive copies of the messages it grammed to include an identifier within their generi- 

originates. cally addressed polling messages and each remote node 

Polimg Protocol of the Parent Application is programmed to recognize that identifier so as to re- 

Hie distributed protocol control process of FIG. 3fl 5 spond to the polling message. If the message is not a 
permits the use of centralized polling. By programming generically addressed poUi^ message (NO branch of 
each node 16 to transmit new data only when it receives block 200X the process carries on with the step of block 
a specific request to do so from its local master node 14, 64 as in FIG. 3a Otherwise (YES branch of block 200 
the master node 14 can sequentially poll aU of its local of FIG. Zb), it determines which one of its incoming 
nodes without having to be connected directly to them. 10 ports (optical fiber cables) received the polling message 
This solves the problem of several nodes independently (block 202 of FIG. Zb), User hardware connected to the 
deciding to transmit different messages which reach the remote node 16 constructs an answering message re- 
master, node 14 or some other point in the network sponsive to the polling message (or else retrieves an 
simultaneously. Such polling is not cumbersome in the answering message it has already constructed from 
network of FIG. .26 because scanning all of the nodes 15 memory) and the remote node 16 transmits the answer- 
should occupy only , a few tens of miUisccoods. K the ing message back down the same port (optical fiber 
message from one node is 1000 bits long and if there are cable) toward the direction from which the polling 
100 nodes, a complete scan comprises 10^ bits. Using message was received (block 204 of FIG. 3b), The re- 
optical fiber links, the anticipated data rate in the net- mote node 16 broadcasts the received polling message 
work of FIG. 2b is 10^ bits per second, so that the time 20 on all of its other ports (block 204 of FIG. 3b), Dcpcnd- 
occupied by all the data is 10-2 seconds. The scan time ing upon the speed of the user hardware coimected to 
will be a few times larger than this, since data from each the remote node 16, the transmission of the poll-answcr- 
node must be transmitted to another node, error- ing message may be virtually simultaneous with the 
checked and re-transmitted. In the improvement de- broadcasting of Uie polling message or may be delayed, 
scribed below, this scan time is minimized to speed up 25 Generally, when receiving messages from other remote 
data acquisition by the master node 14. nodes and relaying them onward, a remote node 16 
Preferred Embodiment of the High Speed Polling Pro- broadcasts such messages on all of its ports (optical 
tocol of the Present Invention fibers). This includes poll-answering messages from 

In the present invention, this scan time is significantly other remote nodes whose ultimate destination is the 

reduced from that of the network described in the par- 30 master node 14. 

ent application by employing a polling message which is Alternative Embodiment of the Hi^ Speed Polling 

not addressed to any particular node (for example, by Protocol 

designating a "generic destination address" or no dcsti- In a different approach, each remote node 16 broad- 
nation address at all), so that each node responds to the casts on all of its ports (optical fibers) the generic pol- 
polling message as it is received. Alternatively, this 35 ling message as received and all poll-answering mes- 
effect is accomplished by simply programming the mi- sages, including those it generates itself as well as those 
croprocessor in each remote node 16 to respond to any received from other remote nodes, so that the "generic" 
received message identifying itself as a polling message polling message and each poU-answering message from 
as if the polling message had been specifically addressed each remote node 16 flood the network. In this embodi- 
to that node. In any case, to poll all of its remote nodes, 40 ment, the transmitting of the polling message and of the 
the master node 14 transmits a single "generic" polling poll answering message generated within the particular 
message once on all of the links 18 connected to it. This remote node 16 is not simultaneous as m the first em- 
polling message b first received at each of the remote bodiment, but rather is sequential. Referring to FIG. 3c, 
nodes 16 which arc connected directly to the master upon receiving a generically addressed polling message 
node 14 (as distinguished from those remote nodes con- 45 (YES branch of block 200), each remote node 16 first 
nected indirectly— through other remote nodes— to the broadcasts the polling message previously received on 
master node 14). After a delay time required for the aU of its ports (block 210) and then, af^er some delay 
nodes to relay the polling message, the next set of re- attributable to user hardware connected to the node, 
mote nodes, namely those of the remote nodes 16 which broadcasts its poll-answering message on all of its ports 
are one node removed from the master node 14, receive 50 (block 212). 
the polling message. Again, after an equal delay time. Hierarchy of Nodes 

the following set of nodes, namely those of the remote In order to permit more frequent polling of critical 

nodes 16 which are two nodes removed from the master nodes and less frequent polling of less important nodes, 

node 14, receive the poUmg message, and so forth, until the individual remote nodes may be programmed to 

after a number of such delay times all remote nodes 16 55 respond only to a special class of polling messages. The 

have received the polling message. class of a polling message may be determined by the 

Referring to FIG. 36, themanner in which the micro- node from the contents of praietennined portions or 

processor of each remote node 16 is programmed to data fields of the polling message. In this case, each 

respond to the "generic" polling message follows the message includes a portion stating the class of the mes- 

process of FIG. 3a, except that after the YES branch of 60 sage (e.g.. one of a predetermined set of integers). The 

block 60, the following is performed; The remote node node is programmed to respond only to those polling 

16 senses whether the message is a generically ad- messages having a particular class or range of classes 

dressed polling message (block 200 of FIG. 36). Such a Alternatively, the individual remote nodes may be 

genericaUy addressed poUing message was treated in programmed to respond only to every n^* polling mes- 

the previous step of block 60 as designating that node as 65 sage received, wherein n is an integer inversely propor- 

its destination, since such a polling message designates tional to the importance of the particular remote node 

all remote nodes 16 as its destination. In order to distin- 16 relative to all other remote nodes in the network, or 

guish generically addressed polling messages from all they may be programmed to respond only to a special 
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class of polling messages. Tbe number n is any integer includable. A set of optical bypass switches <!>6, 68 en- 

and may even assume the value of infinity, in which able an incoming message to be relayed directly to the 

case the node is programmed to never respond to a next node. When a node 16 or 20 is in service (i.e., is not 

polling message. For the most important nodes, n= 1. bypassed), it acts as a repeater for incoming signals. The 

In accordance with the foregoing polling feature of 5 advantage of such frequent repetition and boosdng of 

the invention, the process of generating a message by the optical signals throughout the networic is that even 

either a master node 14 or a node 16 which has received slight optical dispersion effects that might appear be- 

a message requesting transmission is as follows: cause of the use of low-grade optical fiber will not accu* 

1) create irdformation portion of message; mulate in the system. 

2) append a imique identification number to the mes- 10 In the preferred embodiment of the invention, the 
sage; switches 66 and 68 perform a "deadman switch" func- 

3) ^pend the identification of the originating node tion whenever the node or its power supply is not func- 
and the destination node (which is all nodes within tioning, in which any incoming message from one of the 
the master node's zone, in the case of a generically optical links 18a or W> is passed directly to the other 
addressed polling message); and 15 one via the optical fibers labelled "optical bypass*' in 

4) transmit the message. FIG. 4. The advantage of this feature is that the failure 
Transferring Control to the Master node of Another of a node cannot interrupt the relaying of messages 
Zone throughout the network. 

Another feature described in the above-referenced As shown in FIG. 4, a microprocessor 80 receives 
parent application permits compensation for the loss of 20 signals from and transmits signals to the optical HnVs 
one of the master nodes 14 in the network. Specifically, 18^ 18^. Any received signals from the incoming opti- 
another master node (or a unit higher in the control cal cables 18a-2 and 18^2 are converted from optical to 
hierarchy) detecting the loss can remotely re-program electrical signals by respective optical-to-electrical con- 
one or more of the nodes 16 to no longer isolate the verters 72, 74. Any signals generated by the micro- 
rone of the network served by the lost master node 14. 25 processor 80 for transmission on either of the outgoing 
This enables a master node serving an adjacent zone of fiber optic cables 18a-i, 18^-1 are converted from elec- 
the network to take over the monitoring and control of trical to optical signals by respective electrical-to-opti- 
all the nodes in the zone of the lost master node. In cal converters 76, 78. Since the microprocessor 80 typi- 
accordance with this feature, each of the nodes 16 may cally transmits and receives bytes of plural data bits in 
be programmed or re-progiammed by a message di- 30 parallel and since the links 18 typically carry the data in 
rected to it from any master node 14. For example, each bit serial form, serial/parallel data conversion between 
node 16 is programmed to re-transmit a received mes- the microprocessor 80 and the "left-to-righf* link com- 
sage destined for another node or to respond to a re- prising the fiber optic cables lSlh2 and 18a-l is per- 
ceived message destined for the node itself, provided formed by a seri^parallel converter 84. Likewise, 
that the message identifies its source as the master node 35 serial/parallel data conversion between the micro- 
14 of the local zone of the node. If failure of the local processor 80 and the **right-to-left** link comprising the 
master node is detected, the master node 14 of an adja- fiber optic cables lSa-2 and 18^1 is performed by a 
cent zone can send a message to each of the nodes in the serial/parallel converter 82. A node memory 86 is typi- 
zone of the failed master node instructing them to begin cally part of the memory in microprocessor 80. The 
responding to messages whose source is the adjacent 40 node memory 86 stores the message identification num- 
zone's master node. Alternatively, the remote nodes 16 ber stack wMch is required in the distributed protocol 
can be programmed to respond to any master node (i.e., process of FIG. 3a. 

a master node in another zone) if their own master (i.e.. Data acquisition and control processing functions 88 
the master controlling their own zone) has not pdled can be performed by the microprocessor 80. The micro- 
them within some predetermined time. 45 processor 80 permits the acquisition and control fane- 
Structure of a Typical Node tions 88 to interface with the network of FIG. 2b. The 
The preferred structure of a simple implementation of structure of the software and hardware embodied in the 
a typical one of the nodes 16 is illustrated in FIG. 4. A acquisition and control functions 88 is largely indepen- 
similar structure may also be used to implement each of dent of the operation of the network of FIG. 2b. For 
the master nodes 14 as well as each of the gateway 50 reasons of efficiency, hardware attached to the micro- 
nodes 20. As mentioned previously herein with refer- processor 80 performs channel encoding and decoding 
ence to FIG. 2b, each of the links 18 is preferably an of data to be transmitted on or received from the optical 
optical fiber link. Each link 18 accommodates two-way links lSa» l%b. In the preferred embodiment of the in- 
traffic and for reasons of economy comprises two opti- vention, it is anticipated that the hnks 18 will employ a 
cal fibers. The apparatus of FIG. 4 can function as ei* 55 differential ^Manchester code. Therefor^ the micro- 
ther an ordinary node 16 which is connected to two processor 80 performs or manages other hardware not 
other nodes 16 via optical links, as an intersection node shown in FIG. 4 which performs differential Manches- 
16 connected to more than two other nodes via more ter encoding and decoding. The microprocessor 80 also 
than two optical links or as a gateway node 20 which is performs other tasks necessary to interface with the 
capable of responding to more than one master node 14 60 network. For example, the microprocessor 80 performs 
and which (in the embodiment of I^G. 26) is connected the distributed protocol control process referred to 
to four other nodes 16 via four optical links. Also, if the above in connection with to FIG. 3a 
apparatus is used in a master node 14, it may be con- One advantage is that the data acquisition and control 
nected to any nmnber of other nodes 16. However, functions 88 may be modified to add new power moni* 
FIG. 4 only shows connections to two bi-directional 65 toring or control functions, for example, without requir- 
optical links ISa, IBb comprising outgoing fiber optic ing any changes in the network of FIG. 2b. It may be 
cables 18a-l and 18^1 and incoming fiber optic cables necessary to provide additional instructions in the mi- 
18a-2 and 186-2, respectively, additional links being croprocessor 80 to enable it to concmiunicate with the 
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additional functions. As a result, the network of FIG. 2b 
may be contiaually improved by the addition and re- 
finement of power monitoring and control ftmctions at 
any or all nodes in the network during the lifetime of 
the network. More importantly, new power monitoring 
and control software and hardware for insertion in the 
acquisition and control apparatus 88 can be developed 
any time during the life of the network independently 
and competitively for purchase and installation by the 
electric utility company owning the network, provided 
the independent developers are apprised of such details 
as the architecture of the microprocessor 80. 

Some examples of peripheral monitoring and control 
functions for the acquisition and control apparatus 88 
are illustrated in FIG. 4. For automatic electric power 
distribution control, each node may have high voltage 
apparatus at an adjacent point in a power line coexten- 
sive with the optical links 18^, ISb, The high voltage 
apparatus is controlled by a peripheral controller 5W 
which receives command signals generated by the data 
acquisition and control apparatus 88 through a signal 
conversion device 96. The conversion device 96 may, 
for example, be a digital-to-analog converter. An isola- 
tor 98 provides high voltage isolation between the con- 
troller 94 and the converter 96. 

Electric power monitoring may be performed by an 
electrical soisor 100, for example, sensing current in the 
power line. The output of the sensor 100 is converted by 
a conversion device 102 to a digital format for process- 
ing by the acquisition and control device 88. If an opto- 
electronic sensor 104 is employed, its output is con- 
verted finom an optical signal to an electrical signal by a 
converter 104 (which also provides high voltage isola- 
tion). The converted electric signal is converted to a 
digital format by a conversion device 108 for processing 
by the acquisition and control apparatus 88. 

In mod^ying the acquisition and control apparatus, 
additional processors may be installed as additional 
elements of the apparatus 88 with new software govern- 
ing their operation to implement the added functions. 
Thus, the acquisition and control apparatus 88 may 
include a number of microprocessors and memories, for 
example. 

Programming Architecture 

The architecture of the node of FIG. 4 is illustrated in 
FIG. 5. The functions of the node, which may be imple- 
mented with the microprocessing devices 80 and 88 
with pre-programmed micro-instructions or software, 
comprise seven layers: an application layer 110, a pre- 
sentation layer 112, a session layer 114, a transport layer 
116, a network layer 118, a link layer 120 and a physical 
layer 122. In the preferred embodiment of the invention, 
each of the layers except the physical layer 122 is imple- 
mented as software or a set of program instructions 
stored in the memories of appropriate node processors. 
The order of these layers is consistent with the well- 
known Open System Intercoimection (OSI) model of 
the International Standards Organization (ISO) (pub- 
lished in Zimmerman, H., (1980) "OSI Reference 
Model— the ISO Model of Architecture for Open Sys- 
tems Interconnection", IEEE TrcTisactions on Commu* 
nications. Vol. COM-28. No. 4, April, pp. 425-432). 

In the invention, the applications layer 110 consists of 
the control and monitoring functions of power distribu- 
tion system operation, or can be other functions in other 
applications of the present invention. As described pre- 
viously herein, the polling function performed by the 
master nodes 14 permits all communication control in 
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the network of FIG. 2& to be concentrated in the master 
nodes 14. The applications layer 110 is largely concen- 
trated m the master nodes 14. In the preferred embodi- 
ment, the applications layer 110 is implemented as a set 

5 of program instructions stored in the memory of the 
processor of each master node 14. If the network of 
FIG. 2b is associated with an electrical power distribu- 
tion network, then the appUcations program instruc- 
tions carry out processes for the master node 14 to 

10 instruct appropriate ones of the nodes 16 in its zone to 
monitor and report "certain power conditions at remote 
locations and to perform certain power control func- 
tions. In this embodiment, the remote nodes 16 would 
store relatively few of the applications layer program 

15 instructions in order to execute appropriate commands 
from their master node 14. 

Hie presentation layer 112 converts data descriptions 
used by applications software in the application layer 
110 into data addresses recognized by lower layers in 

20 the architecture of FIG. 5. The presentation layer 112 is 
implemented in the microprocessor 80. 

The session layer 114 performs the polling function 
described above facilitated by the steps of blocks 60, 62 
and 64 in FIG. Za and is also implemented in the micro- 

25 processor 80. 

The transport layer 116, in one embodiment, may 
perform error detection and. correction and is likewise 
implemented in the microprocessor 80. In addition, the 
transport layer 116 is also able to detect variations in the 

30 network layer 118, for example to perform network 
diagnostics or to use different embodiments of this in- 
vention. 

The network layer 118 is implemented in the micro- 
processor 80 and performs the distributed protocol 

35 control process of the steps of blocks 48, 50, 52 and 54 
in FIG. 3a This process floods the network of FIG. 2b 
with many copies of the same message by virtue of the 
message replication operation performed by the nodes 
16 or 20,^- as described hereinabove. 

40 The data link layer 120 frames the data into blocks, in 
accordance with well-known techniques (such as AN- 
SI/IEEE Standard 802,3) and is implemented in hard- 
ware attached to the microprocessor 80. However, 
unlike the prior art, this layer issues no re-transmission 

45 requests in the event of an error. There seems little to be 
gained by retaining the conventional technique of mes- 
sage receipt acknowledgement. Since fiber optic links 
generally have a bit error rate of 10- ^ or better, the 
probability of sending an error-free message of 1000 bits 

50 in the network of FIG. 26 is (1-10-5) looo^ which is a 
success probability of 99.99990%. It therefore seems 
inherentiy wasteful to devote any amount of effort to 
acknowledging successful reception of data. 
The physical layer 122 includes the fiber optic links 

55 18 of FIG. 2b and also includes non-fiber optic low 
speed links. Therefore, in one embodiment of the inven- 
tion, the physical layer 122 is a hybrid, as illustrated in 
FIG. 7. The primary or fiber optic network consists of 
the fiber optic hnks 18 and the remote nodes 16 of FIG. 

60 7, corresponding to the network of no. 2b The sec- 
ondary or non-fiber optic network consists of the power 
line carrier input/outputs 130a and 1306 of the primary 
nodes X6ck 166, and the secondary power lines 132a 
134a 132^^ 1346 connecting each power customer 136 

65 with a respective stepdown transformer 138a 1386. 
Sensors 140 at the customers 136 report their findings 
via power line carrier to the appropriate node 16a 166. 
If the node 16a obtains a reading from a secondary 
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monitor 140^; for example, it reports this reading to its 
local master node 14 (not shown in FIG. 7). 

The advantage of the hybrid nature of the physical 
layer 22 is that it enables the continued use of existing 
load-control and meter-reading hardware, which in 
turn implies minim nm need to enter the customer's 
premises for installatioa Further, communication into 
the home can be compatible with other communication 
applications of home wiring (for example the FLBus of 
the Electronic Industries Association ^lA) Home Au- 
tomation Standard). An EIA PLBus interface at each 
distribution transformer would aUow the utility com- 
pany to accomplish far more control than simple man- 
agement of one load Not only could there be ihc capa- 
bility of emergency load-shedding, but a solution to 
cold load pickup problems would be available. Other 
features, such as re-setting clocks in subscribers' homes 
after power failures, may also be developed. 

In cost terms, a hybrid of this kind is certain to be 
competitive if more than one function is to be per- 
formed by the distribution automation system. Feeder 
automation functions can' be implemented competi- 
tively and demand side management can be added at 
extremely low cost The small size of the network to be 
covered by the DLC or home wiring system on the 
non-fiber optic links (typically 3 or 4 homes) greatly 
eases its communications requirements. Very low 
power, inexpensive modules operating at about 120 kHz 
are widely available, and signalling speeds up to 1200 ^ 
baud are possible. The incremental cost of adding this 
capability and other functions at the customer level 
would be minimized 

For reasons of cost, the fiber optic links 18 arc prefer- 
ably multimode fibers with near-infrared LED transmit- 35 
ters operating at a bit rate of between 10 and 15 MHz. 
The non-fiber optic luiks in the secondary circuits em- 
ploy low-power power line carrier transmissions, as 
discussed above. 
Message Format 

FIG. 6 illustrates one exemplary format for the mes- 
sages communicated in the network of FIG. 2& Each 
message is a serial packet of bits of which the first block 
170 specifies the message's unique identification num- 
ber, the second block 172 contains the message data, the 45 
third block 174 specifies the destination address and the 
fourth block 176 specifies the source address of the 
message (i.e., a particular node 16 or 20 or master node 
14). 

In the present invention, in order to accomodate the 
generic addressiog of polling messages to all nodes 
within a particular zone, for example, the block 174 
containing the destination address data consists of two 
address blocks, namely an upper address block t74a and 
a lower address block 174b specifying the upper and 
lower bounds of the address range of the zone all of 
nodes to which the polling message is addressed. All 
remote nodes 16 within a particular zone are addressed 
in a numerical order so that all of their addresses are 
specified by simply specifying the high and low ad- 
dresses bounding their range of addresses. 

For this purpose, each node processor 80 is pro- 
grammed to respond if its local address falls within the 
range of addresses between the upper and lower ad- 
dresses contained in the destination address block 174. 
For other types of messages which are to be addressed 
to a single node only, the upper and lower addresses in 
the block 174 would be the same address. 



16 



40 



50 



55 



60 



65 



In one embodiment, the presence of different address 
values m the two address blocks 174c and 1746 func- 
tions as a flag to the remote node which distinguishes 
the message as a generically addressed polling message. 
Any message so distinguished is treated in accordance 
with the process such as that described above with 
reference to FIG. 3b, The foregoing is readily imple- 
mented using well-known techniques in the art 

While the network of FIO. 2b has been described 
above as being co-extensive with an electrical power 
distribution system including phiral power substations 
in which each master node 14 is located, the invention 
may also be employed in a manner in which the net- 
work of FIG. 2b is coextensive with the internal nodes 
within a power substation, so that each individtial node 
14, 16 or 20 corresponds with an individual location 
within the power substation. 

While the invention has been described in detail by 
specific reference to preferred embodiments thereof, it 
is understood that variations and modifications thereof 
may be made without departing fi-om the true spirit and 
scope of the invention^ 
What is claimed is: 

1. A communication network comprising: 

a plurality of remote nodes, each of said remote nodes 
comprising node processor means for repeating 
received messages addressed to others of said 
nodes; 

a plurality of links which connect said plural nod^ in 
a network of said nodes; 

means for transmitting a polling message addressed to 
at least plural ones of said remote nodes; and 

wherem each of said remote nodes comprise poll- 
responsive means responsive upon receipt of said 
polling message for transmitting a poll-answering 
message and for relaying said polling message to 
others of said remote nodes; 

wherein each remote node is connected to plural ones 
of said links, and wherein said poll-responsive 
means comprise: 

means for sensing which one of said plural links 
connected to said node said polling message 
arrived 01^ and 

means responsive to said means for sensing for 
transmitting said poll-answering message on the 
link on which said polling message arrived while 
simultaneously transmitting said polling message 
on another link to which said node is connected; 
wherein each of said remote nodes further comprises: 

means for sensing a poll-answering message re- 
ceived on one of said links from another one of 
said remote nodes; and 

means responsive to said means for sensing a poll- 
answering message for transmitting said poll- 
answering message received from said other one 
of said remote nodes on all links to which said 
node is connected. 

2. The communication network of claim 1 wherein 
said poU-responsive means comprises means for re- 
sponding only to a particular class of palling messages. 

3. The communication network of claim 2 wherein 
said class corresponds to contents of a predetermined 
portion of said polling message. 

4. The communication network of claim 1 wherein 
each of said node processor means further con^rises 
distributed protocol means for terminating a message 
which has been received at the corresponding node 
more than once. 
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5. The communication network of daim 4 wherein 
said node processor means comprises: 

means for originating a message comprising an infor- 
mation portion; 

means for appending a unique identification number 5 
to said message; 

stack memory means for storing the identification 
number of each received message; and 

wherein said distributed protocol means comprises 
means: for comparing the identification number of 
each received message with the identification num- 
bers stored in the stack memory means so as to 
determine whether to repeat the received message. 

6. The communication network of claim 1 wherein: 
said means for transmitting a polling message on said 

links comprises a master node in said network, said 
master node being connected by respective ones of 
said links to at least one of said remote nodes; 
said communication network is co-extensive with an 
electrical power distribution network, at least some 
of said remote nodes further comprising power 
distribution automation apparatus and said master 
node comprising power substation control unit 

7. The communication network of claim 6 wherein 
said distribution automation apparatus comprises at 
least one of: 

sensing means for monitoring a parameter of said 
electrical power distribution network, and 

regulation means for controlling apparatus in said 
power distribution network. 

8. The communication network of claim 7 wherein 
said master node comprises automation processing 
means for executing a set of stored application program 
instructions to manage the distribution automation ap- 3^ 
paratus of corresponding remote nodes. 

9. The communication network of claim 8 further 
comprising a set of secondary nodes connected to re- 
spective ones of said remote nodes by secondary links, 
wherein said link means connecting said remote nodes 40 
comprise fiber optic cables and said secondary links 
comprise relatively low bandwidth non-fiber optic 
links. 

10. The commimication network of claim 9 wherein 
said power distribution network comprises a high*volt- 
age primary circuit and a plurality of low-voltage sec- 
ondary circuits receiving power through step-down 
transformer means from said primary circuit, wherein 
said secondary nodes are co-located with respective 
ones of said secondary circuits, said secondary links 
comprising power line carrier means for coupling be- 
tween said secondary nodes and said remote nodes 
through said primary and secondary circuits. 

11. The communication network of claim 1 further 
comprising bypass means in each node for permitting 
received messages to bypass a node. 

12. The communication network of claim 1 wherein 
said communication network is co-extensive with an 
electrical power distribution substation, at least some of 
said remote nodes further comprising apparatus within 
said electrical power distribution substation. 

13. A communication network comprising: 
a plurality of remote nodes, each of said remote nodes 



means for transmitting polling message addressed to 

at least plural ones of said remote nodes; and 
wherein each of said remote nodes comprise poU- 
responsivc means responsive upon receipt of said 
polling message for transmitting a poll-answering 
message and for relaying said polling message to 
other of said remote nodes; 
wherein said poll-responsive means comprises means 
for responding to a polling message after receiving 
n polling messages and for refraining from respond- 
ing to intervening polling messages, wherein n is an 
integer individually assigned to an individual node, 
whereby different nodes respond to polling mes- 
sages at different rates. 

14. A communication network comprising: 
a plurality of remote nodes, each of said remote nodes 

comprising node processor means for repeating 
recdved messages addressed to others of said 
nodes; 

a plurality of links which connect said plurality of 

remote nodes in a network of said nodes; 
means for transmitting a polling message addressed to 

at least plural ones of said remote nodes; and 
wherein each of said remote nodes comprise poll- 
responsive means responsive upon receipt of said 
polling message for transmitting a poll-answering 
message and for relaying said polling message to 
others of said remote nodes; 
wherein said means for transmitting a polling message 
on said links comprises a master node in said net- 
work, said master node being connected by respec- 
tive ones of said links to at least one of said remote 
nodes; 
wherein: 

said remote nodes are divisible into a plurality of 
zones of said remote nodes, each of said zones 
including its own master node comiected to at 
least one of the remote nodes within the zone, 
and 

said node processor means fiirther comprises 
means for inhibiting the repeating of received 
messages not originated by a master node in the 
corresponding zone. 

15. The communication network of claim 14 wherein 
each master node further comprises: 

means for broadcasting a changeover message in- 
structing the remote nodes in another zone to re- 
spond to messages originated in the one zone. 

16. The communication network of claim 14 further 
comprising gateway nodes connected to remote nodes 
in adjacent ones of said zones. 

17. The communication network of claim 16 wherein 
said gateway nodes comprise gateway node processor 
means for repeating or responding to received messages 
originated in the adjacent zones. 

18. The communication network of claim 17 wherein 
messages originated in adjacent zones travel along com- 
mon paths shared by the adjacent zones. 

19. The communication network of claim 14 wherein 
60 said node processor means further comprises means for 

permitting polling of remote nodes in one zone by a 
master node of another zone upon failure of a master 
node of said one zone to poll said remote nodes of said 
one zone within a predetermined time interval by over- 
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comprising node processor means for repeating 

received messages addressed to others of said 65 riding said means for inhibiting, 
nodes; 20, A communication network comprising: 

a plurality of links which connect said plural nodes in a plurality of remote nodes, each of said remote nodes 
a network of said nodes; comprising node processor means for repeating 
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received messages addressed to others of said means for sensing which one of said plural linVg 

nodes; connected to said node said polling message 

a plurahty of links which connect said plural codes in arrived on; and 

a network of said nodes; means responsive to said means for sensing for 
means for transmitting a polling message addressed to S transmitting said poU-answering message on the 
at least plural ones of said remote nodes; and link on which said polling message arrived while 
wherein each of said remote nodes comprise poll- simultaneously transmitting said polling message 
responsive means responsive upon receipt of said on another link to which said node is coimcctcd; 
polling message for transmitting a poll-answering wherein said means responsive to said means for sens- 
message and for relaying said polling message to 1° "^S transmits said polling message on all other links 
others of said remote nodes; to which said node b connected; and 
wherein each remote node is connected to plural ones wherem each of said remote nodes further comprises: 
of said links, and wherein said poll-responsive means for sensing a poU-answering. message re- 
means comprise; ceived on one of said links from another one of 
means for sensing which one of said plural Hnks ^aid remote nodes; and 
connected to said node said polling message means responave to said means for sensing a poll- 
arrived on; and answering message for transmitting said poll- 
means responsive to said means for sensing for answering message received from said other one 
transmitting said poll-answering message on the remote nodes on all links to which said 
link on which said polling message arrived whfle ^ ^ connected. 

simultaneously transmitting said polling message ^' commumcation network of claim 23 wherein 

on another link to which said node is connected; poU-responsive means comprises means for re- 

whercin said means responsive to said means for sens- ^ponding only to a particular class of polling messages, 

ing transmits said polling message on all other links „ J^^ commumcation nctworit of claim 24 wherein 

to which said node is connected: " said dass corresponds to contents of a predetermined 

wherein said poU-responsive means comprises means POf^^ff said pollmg message^ 

for responding to a polling message after receiving ^ conamimcation network of dami 23 wherem: 

n polling mes^ges and foTrefrainkig from respond^ ^ ?^ ^^^^ a poUmg message on said 

u yvuuis imsKHx^ra oiiu lui wx ammg iiuui lopuiiu compriscs a master mode in said network, said 

mg to mtervemngpoUmg messages, wherem n is an «,«c*«r«oSJwI: ^"'^'v 

• f • J- ^Tii • T™^ , J- -J 1 J 30 master node oemg connected by respective ones of 

mteger mdividually assigned to an mdividual node, , ^ , rf *«f^"vc oi 

L t j-/r * J J ^ ^d links to at least one of said remote nodes* 

whereby different nodes respond to polling mes- ^^i^ ^oT«r».>«;^*;«« v 

sages at different rates. said conmiumcation net^^^^ 

.-^Sr^ . ^ ^ t, r 1 • t • electncal power distnbution network, at least some 

21. Tliecomniumcationnetworkofc^ of said r^ote nodes further comprising pc^ 
each of said node processor m^ fuller comprises 35 distribution automation apparatus aid said ^ 
dismbuted protocol means for termmatmg a message comprising power substation control mut. 
which has been received at the correspondmg node 2% The communication network of claim 26 wherein 
more than once. , * 1 • 1. - ^aid dbtribution automation apparatus comprises at 

22. The commumcation network of claun 21 wherem i^^^ ^f. '^'^ *^ 

said node processor means comprises: 40 sensing means for monitoring a parameter of said 

means for ongmatmg a message compnsmg an mfor- electrical power distribution networit, and 

mation portion; . , regulation means for controlling apparatus in said 

means for appendmg a umque identification number distribution nctworl^ 

to said message; ^ . 28. The communication network of claim 26 wherein 

stack memory means for storing the identification 45 said master node comprises automation processing 
number of each received message; and Cleans for executing a set of stored appUcation program 

wherem said distributed protocol means comprises instructions to manage the distribution automation ap- 
means for comparmg the identification number of paratus of corresponding remote nodes 
each received message with the identification num- 29. The communication network of claim 26 further 
bers stored m the stack memory means so as to 50 comprising a set of secondary nodes connected to re- 
determine whether to repeat the received message. spectivc ones of said remote nodes by secondary links, 

23. A commumcation network compnsmg: wherein said link means connecting said remote nodes 
a plurality of remote nodes, each of said remote nodes comprise fiber optic cables and said secondary links 

comprising node processor means for repeating con4)Tise relatively low bandwidth non-fiber optic 

received messages addressed to others of said 55 links. 

30. The commnnication network of claim 29 wherein 
a pluraUty of links which connect said plural nodes in said power distribution network comprises a high-volt- 
a network of said nodes; age primary circuit and a plurality of low-voltage sec- 
means for transmitting polling message addressed to ondary circuits receiving power through step-down 
at l^t plural ones of said remote nodes; and 60 transformer means from said primary circuit, wherein 
wherein each of said remote nodes comprise poll- said secondary nodes are co-located with respective 
responsive means responsive upon receipt of said ones of said secondary circuits, said secondary links 
polling message for transmitting a poll-answering comprising power line carrier means for coupling be- 
message and for relaying said polling message to tween said secondary nodes and said remote nodes 
others of said remote nodes; 63 through said primary and secondary circuits, 
wherein each remote node is connected to plural ones 31 The communication network of claim 23 further 
of said links, and wherein said poU-responsive comprising bypass means in each node for permitting 
means comprise: received messages to bypass a node. 
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32. The communicatioii network of claim 23 wherein 
said communicatioii network is co-extensive with an 
electrical power distribution substation^ at least some of 
said remote nodes further comprising apparatus within 
said electrical power distribution substation. 

33. The communication network of claim 23 wherein 
said poll-responsive means comprises means for re- 
sponding to a polling message after receiving n polling, 
messages and for refiraining from responding to inter- 
vening polling messages, wherein n is an integer indi- 
vidually assigned to an individual node, whereby differ- 
ent nodes respond to polling messages at different rates. 

34. The communication network of claim 23 wherein 
each of said node processor means further comprises 
distributed protocol means for terminating a message 
which has been received at the corresponding node 
more than once. 

35. The communication network of claim 34 wherein 
said node processor means comprises: 

means for originating a message comprising an infer- 20 

mation portion; 
means for appending a unique identification number 

to said message; 
stack memory means for storing the identification 

number of each received message; and 
wherein said distributed protocol means comprises 
means for comparing the identification number of 
each received message with the identification num- 
bers stored in the stack memory means so as to 
determine whether to repeat the received message. 
3€. The communication network of claim 23 wherein 
said means for transmitting a polling message on said 
links comprises a master node in said network, said 
master node being connected by respective ones of said 
links to at least one of said remote nodes. 
37. The conununication network of claim 36 wherein: 
said remote nodes are divisible into a plurality of 
zones of said remote nodes, each of said zones 
including its own master node comiected to at least 
one of the ronote nodes within the zone, and 
said node processor means further comprises means 
for inhibiting the repeating of received messages 
not originated by a master node in the correspond- 
ing zone. 
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43. A commimication network comprising: 

a plurality of remote nodes, each of said remote nodes 
comprising node processor means for repeating 
received messages addressed to others of said 
nodes; 

a plurality of links which connect said plural nodes in 

a network of said nodes; 
means for transmitting a polling message addressed to 

at least plural ones of said remote nodes; and 
wherein each of said remote nodes comprise poU- 

responsive means responsive upon receipt of said 

polling message for transmitting a poll-answering 

message and for relaying said polling message to 

others of said remote nodes; 
>yherein each remote node is connected to plural ones 

of said links, and wherein said poll-responsive 

means comprise: 

means for sensing which one of said plural links 
connected to said node said polling message 
arrived on; and 
means responsive to said means for sensing for 
transmitting said poll-answering message on the 
link on which said polling message arrived while 
simultaneously transmitting said polling message 
on another link to which said node is connected; 
wherein said means responsive to said means for sens- 
ing transmits said polling message on all other links 
to which said node is connected; 
wherein said means for transmitting a polling message 
on said links comprises a master node in said net- 
work, said master node being connected by respec- 
tive ones of said links to at least one of said remote 
nodes; and 
wherein: 

said remote nodes are divisible into a plurality of 
zones of said remote nodes, each of said zones 
including its own master node connected to at 
least one of the remote nodes within the zone, 
and 

said node processor means further comprises 
means for inhibiting the repeating of received 
messages not originated by a master node in the 
corresponding zone. 

44. The communication network of claim 43 wherein 



38. The communication network of claim 37 wherein 45 each master node further comprises: 
each master node further comprises: means for broadcasting a changeover message in- 

means for broadcasting a changeover message in- structing the remote nodes in another zone to re- 

structing the remote nodes in another zone to re- spend to messages originated in the one zone, 

spond to messages originated in the one zone. 45. The communication network of claim 43 further 

39. The communication network of claim 37 further 50 comprising gateway nodes connected to remote nodes 
comprising gateway nodes connected to remote nodes in adjacent ones of said zones. 

in adjacent ones of said zones. 46. The communication network of claim 45 wherein 

40. The communication network of claim 39 wherein said gateway nodes comprise gateway node processor 
said gateway nodes comprise gateway node processor means for repeating or responding to received messages 
means for repeating or responding to received messages 55 originated in the adjacent zones. 

originated in the adjacent zones. 47. The communication network of claim 46 wherein 

41. The communication network of claim 40 wherem messages originated in adjacent zones travel along com- 
messages originated in adjacent zones travel along com- mon paths shared by the adjacent zones. 

mon paths shared by the adjacent zones. 48, The conununication network of claim 43 wherein 

42. The communication network of claim 37 wherein 60 said node processor means further comprises means for 



said node processor means further comprises means for 
permitting polling of remote nodes in one zone by a 
master node of another zone upon failure of a master 
node of said one zone to poll said remote nodes of said 
one zone within a predetermined time interval by over- 
riding said means for inhibiting. 
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permitting polling of remote nodes in one zone by a 
master node of another zone upon failure of a master 
node of said one zone to poll said remote nodes of said 
one zone within a predetermined time interval by over- 
riding said means for inhibiting. 
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